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Definition 1. Let A be a square, nonsingular matrix. Then the inverse matriz A! of A is a 
unique matrix for which, 
AA1=[=A1A 


8 
Example 1. An inverse matrix may be found using the formula, 
At= : Adj A 
| A| 


Example 2. Matrix equations of the form Ax = b can be solved with the help of the inverse 
matrix A~! as x = A~'b, where A is an n x n matrix, x a vector of size n whose components are 
variables, and b a vector of size n containing constants. 


Theorem 1. Let A be the coefficient matrix and A; a matrix formed from A by replacing the 
column of coefficients of x; with the column vector of constants. Cramer’s rule solves a system of 
linear equations through the use of determinants as follows. 


_ [Ail 
| A| 


xy 


Problem 1. Prove Cramer’s rule, Theorem 1. 


Definition 2. Let a system of n functions not necessarily linear be 


Yl =fi (Pigen ssi) 


Un = Ini Lisenipea) 


Then a Jacobian determinant comprises all the first-order partial derivatives of the system arranged 
in ordered sequence, that is 


Oy... OM 
024 OXn 
— Oyi,.--;OYn par Fs 7 . 
| J | = | O82, 08 x (|) ty 
Oyun  .,, OY 
O21 Or, 


8 


Theorem 2. Let a system of n equations be y; = fi (@1,...,%n), i= 1,...,n. If |J| = 0, then 
y; are functionally dependent. On the other hand if |. J| 4 0, then y; are functionally independent. 
8 


Problem 2. Prove Theorem 2. 


8 


Definition 3. A determinant | H | composed of all the second-order partial derivatives, with the 
direct partials on the principal diagonal and the cross partials off the same, is called a Hessian. In 
other words, let a multivariable function be z = f(x,y). Then the Hessian of z is 


zyx Zyy 
where Zzy = Zyx. Moreover, the first principal minor is | Hi | = zz and the second principal minor 
is 
Zen fe 2 
| H2| = 4) = Zae2yy — (Zany) 
Zay  Zyy 
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8 


Theorem 3. Let a multivariable function be z = f(x,y), and let the first-order conditions 
2, = Zy =O are met. Then a sufficient condition for z to be at optimum is Zz22Zyy > (Zey)? together 
with zzz, Zyy <0 in case of a maximum and Zz, Zyy > 0 in case of a minimum. 

8 
Problem 3. Prove Theorem 3, the theorem on the optimality of a multivariable function. 


8 


Definition 4. From Definition 3, if | H, | > 0 and | H2| > 0 the Hessian | H | is said to be positive 
definite, and the second-order conditions for the minimum are met. If | H, | < 0 and | H2| > 0 it is 
said to be negative definite, and the second-order conditions for the maximum are met. 


8 
Algorithm 1 Procedure to test for the optimality of multivariable functions of two variables. 
z= f(x,y) 
find z, and zy, 
if z; =0 and z, = 0 then 
find zp2, Zry and Zyy 
find Ay and Ay 
if | H,| > 0 and | H2| > 0 then 
| H| is positive definite 
elseif | H, | <0 and | Hz > 0| then 
| H| is negative definite 
endif 
endif 
Definition 5. Let y = f(x1,...,2n) be function of n variables. Then the n‘>-order Hessian for 
this function is 
Yiroc'* Yin 
|H|= 
Ynl ih YUnn 
Then the first principal minor | H, | is simply x11, and the i*” principal minor is 
Yuroct Yui 
| Hi| = : 
Yi oc Vii 
8 
Theorem 4. Let y = f(x1,...,%n) be function of n variables. Let the Hessian of y be represented 


by ||. Then if all the principal minors of | H | are positive, then | H | is positive definite and the 
second-order conditions for a relative minimum are met. If the sign of the principal minors alter- 
nates between negagive and positive, then | H | is negative definite and the second-order conditions 
for a relative maximum are met. 


8 
Example 3. For y = f(#1, 22,23) the third-order Hessian is 
Yr Y12— 13 
| H | = }Y21 Y22 Y23 
Y31 Y32 Y33 
where 9 2 
y y and so on 


Y= a2 Y12 = 5r0u, 


The first-, second- and third-order Hessian’s are respectively 


Yu Ye Yur Yi2- 13 

[Mil=yi, |Ael= and | H3|=/yo1 yoo Yyo3 
Y21 = Y22 

¥31 =«Y32———«¥33 


Business Mathematics, Linear algebra —2- From 5” November 2005 , as of 10°” December, 2005 


Department of Mathematics, Mahidol University Kit Tyabandha, PhD 


If |H,| > 0, | H2| > 0 and | H3| > 0, then H is positive definite and the second-order condition 
for minimum is fulfilled. If | Hi | < 0, |H2| > 0 and | H3| < 0, then | H| is negative definite and 
the second-order condition for maximum is satisfied. 


Definition 6. A discriminant is a determinant of a quadratic form. Let the quadratic form be 
z= ax? 4+ bry + cy”, which is in matrix form 


z=le ul| 


NIc & 


Then the discriminant is 


aQ NID 


1D|=| 


NIe & 


The first principal minor of the discriminant is | D; | = a, and the second principal minor 


b2 
= ac—- — 


4 


oO NIC 


| Do |= 


a 
b 
2 


Theorem 5. Let a quadratic form be 
z= ax? + bay 4+ cy” 


and let the discriminant of z be | D|. If | Di; | > 0 and |D2| > 0, then | D| is positive definite and 
z > 0 for all z,y £0. If |D,| < 0 and | Dg| > 0, then | D| is negative definite and z < 0 for all 


x,y #0. 
8 


Theorem 6. Let f(x,y) be a function subject to a constraint g(x,y) = k, where k is a constant. 
Then the optimisation of f can be done by first transforming f together with g into a new function 


F(z,y,) = f(x,y) +A (k- gz, y)) 


and then solve the following equations, 


F,(x,y, A) = 0 
Fy(x,y,A) = 0 
F,(x,y,A) = 0 


to obtain the critical values x9, yo and Ap at which F and hence f are optimised. 


8 


Problem 4. Prove Theorem 5, the definiteness of a function by the discriminant. Prove the 
theorem for constrained optimisation with Lagrange multipliers, Theorem 6 above. 


8 


Definition 7. In the constrained optimisation with Lagrange multipliers in Theorem 6 above, f 
is called an objective or origin function and F the Lagrangian function. 


8 


Definition 8. Let f(x1,...,@n) be a function of n variables subject to constraints g(x1,...,n). 
Let F(x1,...,%n,A) = f(x,..-,2n) + A(k—G(a1,.--,2n)). Then the bordered Hessian | H | is 
defined as either 


Fup Fig s+ Fin 
Foy g2 
|H|=| : rod 
Fni Eun Gn 
go g2 t+ gn OO 
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or 


0 91 Gn 
7 gn Fu Fin 
|H|= 
gn Fu Fan 
This is simply the Hessian 
Fyy oct) Fin 
Fri ie Fan 


bordered by the first derivatives of the constraint with zero on the principal diagonal. The order of 
a bordered principal minor being determined by the order of the principal minor being bordered, 


| H| =|H,,| since in this case an n x n principal minor is being bordered. 

8 
Theorem 7. Let f(x1,...,%n) be a function of n variables subject to constraints g(x1,...,2n). 
Let | H| be the bordered Hessian defined in Definition 8. Then if | H2|,...,|Hn| < 0, then the 


bordered Hessian | A | is positive definite, and therefore is a sufficient condition for a minimum. If 
| H2| > 0|H3| < 0, | H4| > 0, and so alternatingly on, then | H| is negative definite, which is a 
sufficient condition for a maximum. 


8 


Problem 5. Prove Theorem 7. 


8 


Example 4. Let f(x,y) be a function to be optimised subject to a constraint g(a, y) = k, where 
k is a constant. Then the Lagrangian function becomes 


F(az,y,A) = f(x,y) +A(k — g(2,y)) 


The first-order conditions for optimisation are FP; = Fy = Fy, = 0. The second-order conditions for 
optimisation can be expressed together as a bordered Hessian 


3 Prox Foy Gu 
|H|=|Fyz Fyy gy 
Gz Gy 0 
or 
7 0 Ge Gy 
Dy Frye Fyy 


Note 1. Theorem 6 gives the first-order conditions for optimising a function subject to some 
constraints. Theorem 7 gives the second-order conditions for optimising a function subject to some 
constraints. 


8 


Definition 9. A Marshallian demand function gives an expression of the amount of a good that 
a consumer will buy as a function of commodity prices and income available. It is derived by 
maximising the utility subjected to a budgetary constraint. 


8 


Example 5. Let a utility be u = qiq2 which is subject to a constraint p1q, + poq2 = b, where b 
is the amount of income available, that is to say, our budget. Then the Lagrangian function is 


U = qigeg + A(b— pig — p24q2) 


The first partial derivatives are then 


U1 = G2 — Ap; = 0 (1) 
uz = qa — Ape = 0 (2) 
Uy, =b—pig — pege = 0 (3) 
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where uj, ug are respectively ug, and u,,. Simultaneously solving Equation’s 1, 2 and 3 leads us to 


 _\_ 4% 
Pl P2 
Hence gz = qipi/p2 and qi = q2p2/pi and from Equation 3 we have, 


Pig P2q2 
b= pigi + p2>— = pogo + pi— 
P2 1 
which yield us, for g; and qz2, the Marshallian demand functions which maximise satisfaction of the 
consumer subject to income and prices. 


Next, we test the second-order conditions by firstly finding u41; = 0, u22 = 0, wig = u21 = 1, 91 = 1 
and g2 = p2, which give us 


_ 0 1 pt 
|H#|=|1 0 p 
Pi pz O 


which gives | Hy | = 2pi1pe > 0 Hence | | is negative definite and thus u is maximised. 


Definition 10. The production process of producing one good usually requires the input of many 
other intermediate goods. Let x; be the total demand for product 7, and let b be the final demand 
for the product from the ultimate users. Then, 


Ce=— 4121 +s. + Ginn + 0; 


for i = 1,...,m, where a;; is a technical coefficient which represents the value of input 7 required 
to produce one monetary unit’s worth of product 7. If we consider the total demand for every one 
of the products, then 

x= Ax+b 


where 
sal Q@1 ""* Gin by 
Xn Anil **' Ann bn 
It follows from this that x = (I — A)~'b. The matrix A is known as the matrix of technical 


coefficients. It is also known as the input-output table, the rows being the inputs and the columns 
the outputs.. The matrix J — A is known as the Leontief matric. 


8 


Example 6. In a complete input-output table, labour and capital would also be included as 
inputs. These give the value added by the firm. They are normally put as an extra row at the 
bottom of the matrix of technical coefficients A. The vertical summation of each column of the 
table is then equal to 1. 


Definition 11. Let A be a square matrix. Then a scalar A such that the equation 
Av = Av (4) 


holds for some vector v # 0 is called an eigenvalue + of A, and the vector v is called an eigenvector 
of A corresponding to the eigenvalue A. The eigenvalue A is also known as the characteristic root, 
or the latent root, while the eigenvector is also known as the characteristic vector, or the latent 
vector. 


8 
Note 2. From Equation 4 it follows directly that 


(A—AI)v =0 (5) 


{+ The word eigenvalue is a half-translation of the German word Figenwert. The latter means 
‘appropriate value’ since Wert means ‘value’ and eigen means ‘proper or appropriate’. 
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Then A — AI is called the characteristic matrix of A. Since v assumes a unique value and by 
assumption v # 0, it follows that A — AJ must be singular, which means that its rows must be a 
multiple of one another. Now A — AI is zero if and only if the characteristic determinant | A — AI | 
of A is zero. In other words 

|A—AI| =0 (6) 


which is called the characteristic equation of A. With Equation 6 there will be an infinite solution 
for v in Equation 5. In particular, if v is a solution, that is if it is an eigenvector, so is kv for any 
k £0. We force a unique solution by using the normalisation 


Sopa 


Then the sign-definiteness of A can be determined from the characteristic roots \’s. Thus if all 
d’s are positive, then A is positive definite; and if negative, negative definite. Let at least one 
be zero, which is neither positive nor negative, if all the remaining \’s are nonnegative, then A is 
positive semidefinite; and if they are nonpositive, negative semidefinite. Lastly, if some of the ’s 
are positive while others are negative, then A is indefinite. 


8 


Problem 6. Prove all the necessary details need to be proved in Note 2. 


8 
Note 3. We have seen in Note 2 how, having found \;, where 7 = 1,...,n, we find through 


normalisation the corresponding, unique v;. On the other hand if we have found first the v;’s, 
their corresponding \;’s may be found by first forming a transformation matrix 


T=[v1... Va] 


and then the corresponding eigenvalues or the characteristic roots are obtained from 


deo SO see 
TY AT = : 2 : : 
ee 
8 
Problem 7. Prove all the necessary details in Note 3. 
8 


Definition 12. The vector equation, Equation 4, has as its solutions the zero vector v = 0 
together with all the corresponding eigenvalue-eigenvector pairs. The set of all the eigenvalues of 
A is called the spectrum of A. The spectral radius of A is then the largest of all the absolute values 
of the eigenvalues of A, that is to say, 

max |As| 


The set of all eigenvectors v;;, together with 0, forms a vector space called the eigenspace of A 
corresponding to ,;. 


8 
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